- 1 - 



FJ-H355 



VIDEO RECORDING AND REPRODUCING APPARATUS 

BACKGROUND OF THE INVENTION 
5 1. Field of the Invention 

The present invention relates to a video 
recording and reproducing apparatus for reproducing a 
plurality of arbitrary image contents or a plurality of 
arbitrary portions of the same image content at the same 
10 time and displaying a plurality of images on the same 
screen at the same time. 

2 . Description of the Related Art 

In recent years, the data storage devices have 
increased in capacity and decreased in price and now find 
15 applications in various walks of life. As an example, 
with the extension of the use of a digital video (DV) 
camera and the start of the digital broadcasting, the 
data storage devices have begun to be used widely for 
recording images. Especially, a magnetic disk, an 
20 optical disk and a magneto-optic disk have superior 

characteristics for recording images due to their fast 
accessibility, low cost and large capacity. 

A single video recording and reproducing 
apparatus having a data storage device of a larger 
25 capacity can store a multiplicity of image contents for a 
long time. By storing broadcast images for a long time 
over a plurality of channels and selecting the desired 
one of the image contents in store, for example, the 
desired image contents can be viewed without recording 
30 reservation. 

Just as it is a very time-consuming job for the 
user to select and view the desired image contents or the 
desired scene included in the image contents from a 
multiplicity of video tapes, it requires a very long time 
35 for the user to select and view the desired image 

contents or the desired scene included in the image 
contents from the data storage medium. Even in the case 
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where the image contents and the scenes are indexed, it 
is required of the user to inefficiently reproduce the 
images one by one and check the contents thereof. The 
image contents are defined herein as meaningful video 
5 data such as a broadcast program, and a scene is defined 
as a series of consistent cuts making up the image 
contents . 

The conventional techniques for viewing a 
plurality of image contents are disclosed in Japanese 

10 Unexamined Patent Publication (Kokai) No. 02-070185 in 
which the contents of a plurality of channels are 
recorded in and reproduced from a magnetic tape at the 
same time, and Kokai No. 11-069302 in which images taken 
from a plurality of angles according to MPEG2 are 

15 displayed at the same time. 

In any of the conventional techniques described 
above, however, only a plurality of images simultaneously 
recorded or a plurality of predetermined images can be 
viewed on the same screen at the time of reproduction, 

20 but it is impossible to search for the desired image 
contents or the desired scene in the image contents 
recorded at different time points. In view of this, it 
is important to realize a viewing function for 
efficiently searching for the image contents or the 

25 desired scene in the image contents recorded at different 
desired time points for each of a multiplicity of image 
contents or long-term image contents . 
SUMMARY OF THE INVENTION 

Accordingly, an object of the present invention is 
30 to provide a video recording and reproducing apparatus in 
which a plurality of image contents recorded at different 
time points or a plurality of portions of the same image 
contents recorded at different time points are reproduced 
at the same time and the resulting plural images are 
35 displayed on the same screen at the same time. 

In order to achieve the object described above, 
according to one aspect of the invention, there is 



provided a video recording and reproducing apparatus 
comprising image synthesizing means for synthesizing into 
a single screen a plurality of images read from randomly 
accessible data storage means for storing the images 
recorded by image recording means, and information 
processing means for controlling the data storage means 
and the image synthesizing means, wherein the information 
processing means controls the data storage means and the 
image synthesizing means in such a manner that a 
plurality of images recorded by the image recording means 
at different time points are read from the data storage 
means and displayed on a single screen as an image 
synthesized by the image synthesizing means. 

With the video recording and reproducing apparatus 
according to the first aspect of the invention described 
above, a plurality of images recorded at different time 
points can be synthesized and displayed on a single 
screen, and therefore the desired image can be found 
within a short time. 

According to a second aspect of the invention, there 
is provided the video recording and reproducing apparatus 
according to the first aspect, in which a plurality of 
images recorded at different time points are either a 
plurality of image contents recorded at different time 
points or a plurality of images recorded at different 
time points in a given one of the image contents. 

According to a third aspect of the invention, there 
is provided the video recording and reproducing apparatus 
according to the first aspect, further comprising user 
interface means interposed between the information 
processing means and the user, wherein special 
reproducing functions including rapid feed and/or pause 
are effected for the image contents arbitrarily selected 
through the user interface means. 

Since the special reproducing functions such as 
rapid feed and pause of the image contents arbitrarily 
selected from a plurality of images is possible, the 



desired image can be efficiently searched for in a 
plurality of image contents, and the desired scene can be 
efficiently searched for in long-term image contents. 

According to a fourth aspect of the invention, there 
is provided the video recording and reproducing apparatus 
according to the first aspect, further comprising user 
interface means interposed between the information 
processing means and the user, wherein a plurality of 
image contents recorded in the data storage means 
constitute a data base and can be searched and sorted, 
and wherein in accordance with the information input by 
the user interface means, at least one of the image 
contents searched for or sorted can be reproduced and 
synthesized and displayed on a single screen at the same 
time . 

A plurality of image contents recorded in the data 
storage means make up a data base and can be searched and 
sorted, so that the image search efficiency can be 
improved further. 

According to a fifth aspect of the invention, there 
is provided the video recording and reproducing apparatus 
according to the first aspect, further comprising user 
interface means interposed between the information 
processing means and the user, wherein the image contents 
selected through the user interface means are converted 
to another image contents and synthesized with the image 
contents being generated and on display on a single 
screen. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a configuration of 
a video recording and reproducing apparatus embodying the 
present invention. 

Fig. 2 is a diagram showing images displayed at the 
time of simultaneous reproduction in a video recording 
and reproducing apparatus according to the invention. 

Fig. 3 is another diagram showing images displayed 
at the time of simultaneous reproduction in a video 
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recording and reproducing apparatus according to the 
invention. 

Fig. 4 is a diagram for comparing and explaining the 
video data that can be reproduced at the same time 
5 according to the invention. 

Fig. 5 is a diagram for explaining by comparison the 
fact that a plurality of arbitrary video data can be 
reproduced at the same time in a video recording and 
reproducing apparatus according to the invention. 
10 Fig. 6 is a diagram for explaining that a plurality 

of arbitrary portions of image contents can be reproduced 
at the same time in a video recording and reproducing 
apparatus according to the invention. 

Fig. 7 is a block diagram showing a configuration of 
15 a video recording and reproducing apparatus according to 
a first embodiment of the invention. 

Fig. 8 is a diagram for explaining the functions of 
the user interface. 

Fig. 9 is a diagram for explaining the operation of 
2 0 image search function. 

Fig. 10 is a diagram for explaining the contents of 
a data base used for image search. 

Fig. 11 is a diagram showing an example of 
displaying an image search result list using the 
25 simultaneous reproducing function. 

Fig. 12 is a diagram for explaining the procedure 
for updating the display of the image search result list. 

Fig. 13 is a diagram for explaining the operation of 
the scene search function. 
30 Fig. 14 is a diagram for explaining a second 

embodiment of the invention. 

Fig. 15 is a diagram for explaining a third 
embodiment of the invention. 

Fig. 16 is a flowchart for explaining a video 
35 recording and reproducing method according to an 
embodiment of the invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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An embodiment of the invention will be described 
below with reference to the accompanying drawings. 

Fig. 1 is a block diagram showing a configuration of 
a video recording and reproducing apparatus embodying the 
5 invention. 

In Fig. 1, the video recording and reproducing 
apparatus comprises, as in the prior art, data storage 
means 11, image recording means 12, a plurality of image 
reproducing means 13, user interface means 14, image 
10 synthesizing means 15 and information processing means 
16. 

The data storage means 11 is a semiconductor memory, 
a magnetic disk, an optical disk or the like random 
access memory and has the function of transferring data 
15 at a data transfer rate required for recording or 
reproducing at least one video data. 

The image recording means 12 has the function of 
fetching and encoding the image-accompanying sound from a 
tuner or the like and transferring the image-accompanying 
20 sound data to the data storage means. 

The image reproducing means 15 has the function of 
receiving and decoding the video data from the data 
storage means 11 and transferring the reproduced image to 
the image synthesizing means 15. 
25 The user interface means 14 has the function of 

fetching a record or reproduce command into the apparatus 
through a button or the like mounted on a remote 
controller or the apparatus body and the function of 
displaying the command on a television monitor or a panel 
30 attached to the apparatus body. 

The information processing means 16 has the function 
of adjusting the timing or rate of transferring the video 
data from the image recording means 12 to the data 
storage means 11 or from the data storage means 11 to the 
35 image reproducing means 15 and the function of 

transmitting information to each means in response to a 
command input by the user through the user interface 



means 14. 

These means combine to perform both the recording 
and reproducing functions like a normal video recording 
and reproducing apparatus on the one hand and have the 
function of simultaneously reproducing and outputting by 
synthesizing a plurality of reproduced images at the same 
time . 

Each of the functions starts the processing in 
response to a command received through the user interface 
means 14. 

In recording mode, the image data obtained by 
fetching and encoding images from the tuner or the like 
in the image recording means 12 are stored in the data 
storage means 11 while at the same time controlling the 
transfer rate thereof by the image processing means 16. 

In reproduction mode, on the other hand, each video 
data is read from the data storage means 11 while 
controlling the transfer rate thereof by the information 
processing means 12, and decoded and output as a 
reproduced image in the image reproducing means 13. 

In simultaneous reproduction mode, as in 
reproduction mode, a plurality of video data are read 
from the data storage means 11 while controlling the 
transfer rate thereof by the information processing means 
16, and the video data are decoded in each image 
reproducing means 13. A group of images reproduced in 
this way are synthesized and output in a single screen by 
the image synthesizing means. 

Fig. 2 is a diagram showing an example of the images 
displayed on the screen using four image reproducing 
means 13. In the case of Fig. 2, the images reproduced 
by the image reproducing means 13 are output to each of 
the areas into which the display screen of the TV monitor 
is segmented substantially into halves both horizontally 
and vertically. The arrangement on the display screen is 
not limited to that of Fig. 2, but the reproduced images 
may alternatively be arranged in one line either 



vertically or horizontally. 

Fig. 3 is a diagram showing another example of the 
images displayed on the screen. In the images displayed 
on the screen shown in Fig. 3, the names attached to the 
5 images are plotted and displayed as a list in the space 
available in the screen. The reproduced image of each 
image content can be displayed immediately beside the 
list of stored image contents or a list of the search 
results, and therefore the image contents can be checked 

10 efficiently. In the case where the reproduced image is 
switched as the result of updating the screen by 
scrolling the screen with the list on display, for 
example, the contents can be checked more easily by 
simply scrolling the screen. 

15 Figs. 4a and 4b show a video data image that can be 

simultaneously reproduced in the prior art and a video 
data image that can be simultaneously reproduced 
according to the invention, respectively. 

The video data that can be reproduced simultaneously 

2 0 in the conventional video recording and reproducing 

apparatus basically begin to be recorded at the same time 
in the manner shown in Fig. 4a or represent predetermined 
images like the stream for multi-angle display in 
conformance with MPEG2 . According to this invention, in 

2 5 contrast, as shown in Fig. 4b, all the video data 

recorded at given time points can be handled. In other 
words, as many video data streams as there are decoders 
can be reproduced at the same time. 

Figs. 5a and 5b are diagrams showing a 

30 simultaneously reproduced image according to the prior 
art and a simultaneously reproduced image according to 
the invention, respectively. 

In the conventional video recording and reproducing 
apparatus capable of simultaneous reproduction, as shown 

35 in Fig. 5a, only the frames recorded at the same time can 
be reproduced at the same time. In the multi-angle 
display stream according to MPEG2, only the data having 



the same time stamp attached thereto can be reproduced at 
the same time. In this way, only predetermined images 
can be reproduced at the same time, and the special 
reproducing functions such as rapid feed are performed 
for all the images reproduced at the same time. 
According to this invention, in contrast, as shown in 
Fig. 5b, the data in arbitrary frames of a plurality of 
image contents can be read out at the same time by 
randomly accessing the data storage unit, and each video 
data is input independently to each decoder. Therefore, 
the special reproducing functions are applicable to each 
video data independently. 

Fig. 6 is a diagram showing another example of a 
simultaneously reproduced image according to the 
invention. As shown in Fig. 6, data can be read at the 
same time from a plurality of the heads of given frames 
of the video data in the data storage unit. 

The operating unit is constituted of buttons or the 
like mounted on the apparatus body, and a command is 
input from the user directly from this operating unit in 
the form of an electrical signal. As an alternative, a 
command can be input from the user by remote operation 
from a portable information terminal or a remote 
controller utilizing an infrared transceiver. 

As described above, according to this invention, a 
group of images reproduced from a plurality of image 
contents recorded at a given time point or a group of 
images reproduced simultaneously from a plurality of 
arbitrarily selected portions of a single image content 
can be synthesized and displayed on a single screen. 
This function makes possible both the operation of 
efficiently searching for the desired one of a plurality 
of image contents and the operation of efficiently 
searching for the desired scene from long-term image 
contents . 

{Embodiment 1) (basic function) 

Fig. 7 is a block diagram showing a video recording 
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and reproducing apparatus according to a first embodiment 
of the invention. As shown in Fig. 7, the video 
recording and reproducing apparatus according to the 
first embodiment comprises a data storage unit 71, an 
5 encoder 72, a decoder 73, an operating unit 74, an image 
synthesizer 75, a central processing unit 76 and a 
display unit 77. According to this embodiment, a 
plurality of arbitrary image contents or a plurality of 
arbitrary portions of the same image content are 
10 reproduced at the same time and the resulting images are 
displayed on the same screen at the same time. The 
images and the image data can include the sound. 
(Recording function) 

First, the recording function will be explained. 

15 The recording function starts encoding the image and 

sound in the encoder 72 in response to a command input by 
the user from the operating unit 74. The image and sound 
may be input from either a tuner or an external source. 
The video data thus encoded are stored by being written 

20 into the data storage unit 71. 

The video data recorded into the data storage unit 
71 may be managed in the form of address and data length 
directly in the data storage unit 71. The use of a file 
system, however, facilitates data management. 

25 By compressing the data amount using an inter frame 

prediction encoding scheme such as ISO/IEC 13818 MPEG2 or 
ISO/IEC 11172 MPEG1 or an intraframe encoding scheme such 
as Motion- JPEG constituting a version of ISO/IEC 10918 
JPEG applied to image sequences, the storage size of the 

30 data storage unit 71 can be reduced. In the case where a 
digital broadcast is received, on the other hand, the 
information encoded by MPEG-TS is obtained and therefore 
all that is required is to retrieve packets of the 
desired channel by the encoder. 

35 (Reproducing function) 

Now, the reproducing function will be explained. 
The reproducing function starts reading the video 



data from the data storage unit 71 in response to a 
command input thereto, by the user, from the operating 
unit 74. The video data is decoded and reproduced in the 
decoder 73. The image thus reproduced is output to the 
TV monitor or the like through the image synthesizer 75. 

Also, the special reproducing functions such as 
rapid feed and pause can be carried out in response to a 
command input by the user. 

In the process, a symbol or a text indicating that 
reproduction or a pause now is underway may be 
synthesized with the reproduced image and displayed on 
the screen. 

(Simultaneous reproducing function) 

The simultaneous reproducing function will be 
explained. 

The simultaneous reproducing function, like the 
reproducing function, starts reading the video data from 
the data storage unit 71 in response to a command input 
by the user. The video data read out include a plurality 
of different video data or a plurality of portions of a 
single video data designated on temporal or other basis. 
The data storage unit 71 is a magnetic disk, an optical 
disk or the like device having a superior random access 
performance for reading a plurality of data substantially 
at the same time by time division or the like scheme. A 
plurality of video data thus read are each reproduced by 
being decoded in the decoder 73. The image group 
reproduced is synchronized and synthesized into a single 
screen in an image synthesizer 75. In the image 
synthesizer 75, the display size and the display position 
of the reproduced image are arbitrarily designated by the 
central processing unit 76. Also, the image synthesizer 
75 synthesizes and displays characters, symbols and bit 
images together with the reproduced images . The display 
image as shown in Fig. 2 or 3 will be used. 
(Display image select function) 

Fig. 8 is a diagram for explaining the display image 
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select function for selecting one of the reproduced 
images and displaying it in the original size over the 
whole screen of the TV monitor. 

In the image synthesizer, as shown in Fig. 8, only 
5 the reproduced image arbitrarily designated by the user 
through the operating unit 74 among the synthesized 
reproduced images is renewed into the original display 
size and displayed. The image synthesizer 75 
constituting auxiliary operation means for the user to 

10 select a reproduced image functions as user interface 
means called GUI (Graphic User Interface) for 
synthesizing the frame surrounding the reproduction 
display unit with the reproduced image and displaying it 
as shown in Fig. 8. 

15 The display size and position are determined 

appropriately by the central processing unit 76. The 
pattern for arranging the reproduction display areas may 
be either a matrix with the data arranged both 
horizontally and vertically, a column form with the data 

2 0 arranged vertically or a row form with the data arranged 
horizontally. Assuming that the number of encoders is K, 
the display of a pattern in a M x N matrix requires that 
K ^ M x N. Specifically, assume that the image size of 
the video data is X0 x Y0 and the size of each 

25 reproduction display area is XI x Yl. In the case where 
the data are displayed in a M x N matrix pattern, the 
display size and position are determined by the central 
processing unit 7 6 in such a manner that the size of each 
reproduction display area in horizontal direction meets 

30 the relation XI £ XO/M, and the size of each reproduction 
display area in vertical direction meets the relation Yl 
^ XO/N. 

(Image search function) 

A highly efficient image search function can be 
35 realized by utilizing the simultaneous reproduction of a 
plurality of different image contents and the special 
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reproduction functions such as rapid feed. In the case 
where there are K decoders, the user can view K images at 
the same time when searching for the desired image. 
Therefore, the operating steps required for reproduction 
5 are reduced to about 1/K. Also, the desired scene can be 
searched for at the same time by effecting the special 
reproduction functions on the reproduced images selected 
arbitrarily by the user as shown in Fig. 9. 

In the process, the image search can be carried more 
10 efficiently by generating a data base in the central 

processing unit 76, in advance, for the image contents 
recorded in the data storage unit 71. The items to be 
registered in the data base include those shown in Fig. 
10. The user can search for the desired image contents 
15 by using the items shown in Fig. 10. Based on the items 
input by the user, the central processing unit 76 
produces a list of candidate items of the image contents 
from the data base. As a result, the reproduction 
display areas are arranged in a column, the image 
20 contents reproduced in the reproduction display areas are 
arranged in a column by the image synthesizer, and the 
items corresponding to the image contents arranged beside 
the reproduction display areas are presented to the user 
in the form of symbols or character strings. Fig. 11 
25 shows an example of display image. In the case where a 
plurality of candidates are displayed in the search 
result list and the desired image contents cannot be 
determined simply by the items, the conventional 
apparatus operates in such a way that the user is 
30 required to check the contents by reproducing the data 
one by one, and before reproducing the desired image 
contents, it is necessary to repeat a plurality of times 
a series of operations of selecting, reproducing, 
subjecting to the special reproduction function the image 
35 contents, if required, and stopping the process. 
According to this invention, in contrast, the 
simultaneous reproducing function can be carried out 



automatically for the search result list, and therefore 
the number of steps of operation by the user is reduced 
for an improved search efficiency. 

Further, even in the case where the number of the 
candidates included in the search result list is greater 
than the number of the encoders 72, i.e. the number of 
the image contents capable of being displayed at the same 
time, the search operation can be performed efficiently 
by scrolling the screen and thus updating the candidates 
on display. In Fig. 12, the screen is scrolled when the 
user intends to select the next candidate. The steps for 
scroll display will be explained with reference to the 
case where the number of the decoders is 4. First, the 
reproduction of the image contents displayed in the 
reproduction display area 1 is stopped. Then, the area 
with which a decoder has thus far been associated for 
display is changed from the reproduction display area 2 
to the reproduction display area 1, followed by changing 
the display position of the related items. Similarly, 
the reproduction display area 2 and the reproduction 
display area 3 are changed. The decoder used first for 
display in the reproduction display area 1 reproduces the 
image contents to be newly displayed, displays it in the 
reproduction display area 4 together with the items . A 
similar process is performed in the case where the user 
intends to select the next candidate. This sequence of 
steps updates the whole display screen and realizes the 
scroll display as shown in Fig. 12. Conversely, in the 
case where a preceding candidate is to be selected, the 
decoding operation for the reproduction display area 4 is 
stopped, and the display area for the decoder thus far 
associated with for display is changed from the 
reproduction display area 3 to the reproduction display 
area 4. In similar fashion, the reproduction display 
area 1 and the reproduction display area 2 are changed. 
Then, the image contents for the preceding candidate are 
reproduced by the decoder involved first in the display 
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in the reproduction display area 4 and displayed in the 
reproduction display area 1 . 

A list of all the image contents, if prepared in 
addition to the search result list, may be displayed in 
5 similar fashion. 

(Scene search function) 

A highly efficient scene search can be realized by 
utilizing the simultaneous reproduction of a plurality of 
arbitrary portions of the same image contents and the 

10 special functions such as rapid feed. An example will be 
explained with reference to Fig. 13 showing the case 
involving four decoders. The upper left part indicates 
that the reproduction is started from the head of the 
image contents, while the upper right part indicates that 

15 the reproduction is started from the point corresponding 
to 30 minutes from the head of the image contents. The 
time information plotted for each reproduction display 
area may be based on the record starting time. A more 
efficient scene search is made possible especially by 

20 using the rapid feed reproduction among the special 

reproducing functions. The special reproduction makes 
possible the operation for all the reproduction display 
areas selected by the user thereby to further reduce the 
user operation. The image contents are selected by the 

25 user on the display screen of a list of image contents or 
the display screen of a list of search results. 
(Transfer control) 

The transfer of the image data required for the 
simultaneous reproduction or the simultaneous special 

30 reproduction is liable to be limited by the transfer rate 
of the data storage function or the transfer rate of the 
data bus. In view of this, the video data of the 
reproduction display area selected by the user are 
transferred at top priority. In this way, the individual 

35 image data transfer rates are regulated in such a manner 
as not to delay the reproduction and the special 
reproduction of at least one reproduction display area. 
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Specifically, as for the image contents low in priority 
order not selected by the user, all the data are not read 
from the data storage unit 71 but the data are 
transferred intermittently by skipping the addresses in 
5 order not to cause any reproduction delay. By this 
transfer control, a plurality of image data 
simultaneously reproduced can be smoothly displayed 
within the range limited by the transfer rate of the data 
storage function and the transfer rate of the data bus. 

10 As for the video data encoded by the intraframe coding 
scheme or the video data not compressed, the data are 
skipped by frame. In the case where data of every other 
frame are transferred, for example, the data transfer 
rate can be halved although the frame rate is also 

15 reduced to one half. As for the video data encoded by 
the interframe prediction encoding scheme, on the other 
hand, the data are skipped by a unit specific to the 
particular encoding scheme. In the case of ISO 11171 
MPEG1, for example, a plurality of frames called GOP 

2 0 (Group of Pictures) are encoded at a time, and therefore 
the data are skipped by GOP. Normally, a predetermined 
number of frames are contained in GOP. In the case where 
data are transferred by being skipped by GOP, therefore, 
the data transfer rate is reduced to one half. 

25 (Embodiment 2) (Sound processing method) 

The image processing method for the simultaneous 
reproduction function was described above. Now, a sound 
processing method will be explained. In the case where a 
plurality of image contents are reproduced at the same 

30 time, the user can retrieve only the useful information 

from the image by moving the point of viewing the screen. 
In the case where the sound of all the image contents 
reproduced at the same time are synthesized at the same 
level, on the other hand, the individual sounds are very 

35 difficult to aurally identify. This is similar to the 
fact that the voices of a plurality of persons speaking 
at the same time cannot be aurally identified easily. 



Therefore, it is necessary to output only the sound in 
the reproduction display area designated by the user. 

Fig. 14 shows a second embodiment of the invention 
representing an example of a configuration of a video 
recording and reproducing apparatus with an improved 
audio output of the video data reproduced at the same 
time. In Fig. 14, the same component parts as the 
corresponding ones in Fig. 7 are designated by the same 
reference numerals, respectively. As shown in Fig. 14, a 
sound selector 141 is added separately from the image 
synthesizer 75. Thus, only the audio output of the image 
contents reproduced in the reproduction display area 
selected by the user is produced through the sound 
selector 141. 

(Embodiment 3) (other apparatus configurations) 
Fig. 15 shows a third embodiment of the invention, 
and represents an example of a configuration of a video 
recording and reproducing apparatus comprising a 
plurality of encoders for simultaneous multi-channel 
recording. As shown in Fig. 15, simultaneous multi- 
channel recording is performed by the provision of a 
plurality of encoders 72. This embodiment is different 
from the conventional simultaneous recording and 
reproducing method in that the recording can be performed 
for each channel independently taking advantage of the 
fact that the data storage unit 71 is randomly 
accessible. Further, the provision of a plurality of the 
data storage units 71 makes it possible to alleviate the 
limitation of the data transfer rate to the reproduction 
transfer rate of the data storage unit 71 at the time of 
simultaneous recording or simultaneous reproduction, in 
the case where the recording and reproducing operations 
are performed at the same time, the data transfer control 
is required to give top priority to the data transfer 
from the encoders 7 2 to the data storage units 71. 
Specifically, in the case where the recording and 
reproducing operations are performed at the same time 



while the data transfer rate required for each image data 
transfer is limited to the data transfer rate of the data 
storage unit 71 or the data bus, the data are obtained 
from the data storage unit 71 intermittently as described 
above in such a manner as to secure the recorded video 
data at least free of drop-off s. 
(Software) 

The functions of the video recording and reproducing 
apparatus described above can be realized with a program 
on most common personal computers. Specifically, apart 
from a personal computer having a random access data 
recorder, an image encoder, an image decoder and an image 
synthesizer, the configuration of a personal computer can 
be replaced with software by employing an image encoding 
module instead of an image encoder and an image decoding 
module instead of an image decoder. 

Fig. 16 is a flowchart for explaining a video 
recording and reproducing method implemented by a program 
according to an embodiment of the invention. In Fig. 16, 
the image-accompanying sound is recorded by image 
recording means 12 in step Sll, and the recorded image- 
accompanying sound is stored in data storage means 11 in 
step S12. The data thus stored are converted into a data 
base in step S13 to permit search and sorting. Then, a 
plurality of image contents recorded at different time 
points or a plurality of images recorded at different 
time points in a single image content are read out and 
synthesized into a single screen by image synthesizing 
means 15 in step S14. In the next step S15, one image 
content or one image is selected from the display screen 
through user interface means 14 and moved on the screen 
by scrolling or the like thereby to display other image 
contents or other images. Then, in step S16, the image 
contents or the images thus changed are synthesized with 
the image contents or images under generation and 
displayed on a single screen. 

The user determines whether the image contents or 
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the images on display are the desired ones or not. 
Unless they are the desired ones, the process returns to 
step S15 to continue the search. In the case where the 
desired screen is displayed, on the other hand, one of a 
5 plurality of the reproduction display areas where a 

plurality of image contents or images are displayed is 
selected thereby to output only the sound corresponding 
to the image contents or the images reproduced in the 
selected reproduction display area. As a result, the 

10 user can hear only the sound corresponding to the desired 
image. The user then determines in step S19 whether the 
search of the image contents or images is to be 
terminated, and if not terminated, the process of steps 
S15 to SI 7 is repeated. 

15 The process explained above with reference to Fig. 

16 can be realized by activating the information 
processing means 16 shown in Fig. 1 or the central 
processing unit 76 shown in Fig. 17 by a program. 

According to this invention, there is also provided 

20 a recording medium for storing the program to realize the 
method described above with reference to Fig. 16. The 
recording medium includes computer readable storage such 
as a CD-ROM, a floppy disk or the like. 

As described above, according to this invention, a 

25 plurality of arbitrary image contents can be reproduced 
at the same time and displayed at the same time on the 
same screen, and a plurality of arbitrary portions of the 
same image content can be reproduced at the same time and 
displayed at the same time on the same screen. Also, 

30 using the aforementioned effects, the number of 

operations by the user for searching for the desired 
image contents can be reduced by displaying while 
reproducing a list of the image content search functions 
or a list of all the image contents on the same screen. 

35 Further, the number of operations by the user for 
searching for the desired scene can be reduced by 
reproducing a plurality of portions of the image contents 
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at the same time, thereby greatly contributing to an 
improved performance of the video recording and 
reproducing apparatus. 



